(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCI) 



(19) World InteDectual Property 
Organization 
International Bureau 

(43) International Publication Date 
14 October 2004 (14.10.2004) 




PCX 



(10) International Publication Number 

wo 2004/088661 Al 



(51) International Patent Clas^catipn;':^, _ G11B.2Q/10. 

(21) International Application Number: 

PCT/KR2004/000369 

(22) International Filing Date: 24 February 2004 (24.02.2004) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 
10-2003-0011521 



24 February 2003 (24.02.2003) KR 



(71) Applicant (for all designated States except US): LG Elec- 
tronics Inc« [KR/KR]; 20, Yoido-dong, Youngdungpo-gu, 
Seoul 150-010 (KR). 

(72) Inventors; and 

(75) Inventors/Applicants (for US only): SEO, Kang Soo 
[KR/KR]; 606-503, Chowon Hanyang Apt., 897-5, Py- 
oungan-dong, Dongan-gu, Anyang, Kyunggi-do 431-075 
(KR). KIM, Byung Jin [KR/KR]; 111-204, Hansol 
Chungu Apt, 110, Jeongja-dong, Bundang-gu, Sungnam, 
Kyunggi-do 463-010 (KR). 



(74) Agent: PARK, Lae Bong; Ifl . Dongun Bldg., 413-4, Do- 
gok 2^ong, Kangnam-gu, Seoul 135-272 (KR). 

(81) Designated States (unless otherwise indicated, for every 
kind of national protection available): AE, AG, AL, AM, 
AT, AU, AZ, BA, BB, BG, BR, BW, BY, BZ, CA, CH, CN, 
CO, CR, CU, CZ, DE, DK, DM, DZ, EG, EE, EG, ES, FI, 
GB, GD, GE, GH, GM, HR, HU, ID, XL, IN, IS, JP. KB, 
KG, KP, KR. KZ, LC, LK. LR, LS, LT. LU, LV, MA. MD. 
MG. MK. MN. MW. MX, MZ. NA. NI. NO, NZ, OM. PG, 
PH. PL, PT, RO, RU, SC, SD, SE, SG, SK, SL, S Y, TJ, TM, 
TN. TR, IT. TZ, UA, UG, US, UZ, VC, VN, YU, ZA. ZM, 
ZW. 

(84) Designated States (unless otherwise indicated, for every 
kind of regional protection available): ARIPO (BW, GH, 
GM, KB, LS, MW, MZ, SD, SL. SZ, TZ, UG, ZM, ZW), 
Eurasian (AM, AZ, BY, KG. KZ, MD, RU, TJ, TM), Euro- 
pean (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, H, FR, 
GB, GR, HU, IE, rr, LU, MC, NL, PT, RO, SE, SI, SK, 
TR), OAPI (BF, BJ, CP. CG. CI, CM, GA, GN, GQ. GW, 
ML, MR, NE. SN. TD. TG). 

Published: 

— with international search report 

[Continued on next page] 



(54) Title: METHODS AND APPARATUSES FOR REPRODUCING AND RECORDING STILL PICTURE AND AUDIO DATA 
AND RECORDING MEDIUM HAVING DATA STRUCTURE FOR MANAGING REPRODUCTION OF STILL PICTURE AND 
AUDIO DATA 



00 
00 



O 



StaiPictwre, OraphSe, 
SuhtitU UP 



121 



Track 



122 



Audio 



V 




A 






A 


ST 




A 


ST 




A 


G 




A 


G 




A 


V 




A 



Mlcro- 
compnter 



131 



TS 
Demiu 



STC 
CoQDter 2 
(Stm) 



STCl^pading 
Ttmitt^ eotUrol 



240 



STC 
Counter 1 
(Audio) 



123 



Video 






Video 


Boifer 






Decoder 


124 




12S 


Graphic 






Graphic 


BnfiTer 






Decoder 


125 




129 


Subtitle 






Sabtme 


Buffer 






Decoder 



127 



S PTS 



126 



170 



S STC 



Andio 




Andio 


Buffer 


► 


Decoder 



A_PTS 



130 



A STC 



(57) Abstract: In the method of reproducing still picture data and audio data from a recording medium, the still picture data and the 
audio data reproduced fxom the recording medium are decoded based on respective, independent system times (STCs). 
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DESCRIPTION 



METHODS AND APPARATUSES FOR REPRODUCING AND 
RECORDEVG STILL PICTURE AND AUDIO DATA AND RECORDING 
MEDIUM HAVING DATA STRUCTURE FOR MANAGING 
5 REPRODUCTION OF STILL PICTURE AND AUDIO DATA 

1. TECHNICAL FIELD 

The present invention relates to methods and apparatuses for 
reproducing and recording still picture and audio data, and to a 
recording medium having a data structure for managing reproduction 
10 of still picture and audio data. 

2. BACKGROUND ART 

The standardization of new high-density read only and 
rewritable optical disks capable of recording large amounts of 
high-quality video and audio data has been progressing rapidly and 
15 new optical disk related products are expected to be commercially 
available in the near future. The Blu-ray Disc Rewritable (BD-RE) 
and Blu-ray Disk ROM (BD-ROM) are examples of these new optical 
disks . 

While the standard for BD-RE has been published, the 
20 standardization for high-density read-only optical disks such as 
the Blu-ray ROM (BD-ROM) is still under way. Consequently, an 
effective data structure for managing reproduction of still 
pictures recorded on the high-density read-only optical disk such 
as a BD-ROM is not yet available. 
25 3. DISCLOSURE OF INVENTION 

The recording medium according to the present invention 
includes a data structure for managing reproduction of still 
pictures and audio data recorded on the recording medium. 

In one exemplary embodiment, still picture data and audio 

1 
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data reproduced from the recording medium are decoded based on 
respective, independent system times (STCs) . For example, a first 
STC for the still picture data is generated based on the still 
picture- data reproduced from the recording medium, anda seGonjd 

5 STC for the audio data is generated based on the audio data 
reproduced from the recording medium. 

In one exemplary embodiment, the first STC is generated from 
program clock references (PCRs) in the still picture data, and the 
second STC is generated from PCRs in the audio data. 

10 In another exemplary embodiment, the still picture data and 

the audio data are decoded based on the first and second STCs, 
respectively, and presentation time stamps (PTSs) in the 
respective still picture and audio data. 

The present invention further provides apparatuses and 

15 methods for recording and reproducing the data structure according 
to the present invention, and recording and reproducing slide shows 
according to the present invention. 

4. BRIEF DESCRIPTION OF DRAWINGS 

The above features and other advantages of the present 
20 invention will be more clearly understood from the following 
detailed description taken in conjunction with the accompanying 
drawings, in which: 

Fig. 1 illustrates an exemplary embodiment of a recording 
medium file or data structure according to the present invention; 
25 Fig. 2 illustrates an example of a recording medium having 

the data structure of Fig. 1 stored thereon; 

Figs. 3 and 4 illustrate a detailed embodiment of portions 
of the data structure in Fig. 1 and a method for managing still 
images of a high-density recording medium according to the present 
30 invention; 

Fig. 5 illustrates a schematic diagram of a partial structure 
of an optical disc reproducing apparatus according to an embodiment 
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of the present invention; 

Fig. 6 illustrates a detailed structure of a first embodiment 
of an optical disc apparatus according to the present invention; 
' • Fig; .7 is- a detailed structure of a second embodiment of an 
5 optical disc apparatus according to the present invention; and 

Fig. 8 illustrates another embodiment of a recording and 
reproducing apparatus according to the present invention. 

5. MODES FOR CARRYING OUT THE INVENTION 

In order that the invention may be fully understood, 
10 exemplary embodiments thereof will now be described with reference 
to the accompanying drawings . 

A high-density recording medium such as a high density 
optical disk, for example, a Blu-Ray ROM (BD-ROM) , BD-RE, etc. in 
accordance with the invention may have a file or data structure 
15 for managing reproduction of video and audio data as shown in Fig. 
1. Some aspects of the data structure according to the present 
invention shown in Fig. 1 are the same as the well-known BD-RE 
standard, as such these aspects will be reviewed, but not described 
in great detail. 

20 As shown in Fig. 1, the root directory contains at least one 

BD directory. The BD directory includes general files (not shown) , 
a PLiAYLIST directory in which playlist files (e.g., *.mpls) are 
stored, a CLIPINF directory in which clip information files 
(*.clpi) are stored, and a STREAM directory in which 

25 MPEG2- formatted A/V stream clip files (*.m2ts), corresponding to 
the clip information files, are stored. 

The STREAM directory includes MPEG2- formatted A/V stream 
files called clip streams files or just clip files. The A/V stream 
includes source packets of video and audio data. For example, a 

30 source packet of video data includes a header and a transport packet . 
A source packet includes a source packet number, which is generally 
a sequentially assigned number that seryes as an address for 
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accessing the source packet. Transport packets include a packet 
identifier (PID) . The PID identifies the sequence of transport 
packets to which a transport packet belongs. Each transport packet 
- ' ' in ■ the'^^ sequence will have the "^same-P-ID*. - - - . : , 

5 The CLIPINP directory includes a clip information file 

associated with each A/V stream file. The clip information file 
indicates, among other things, the type of A/V stream associated 
therewith, sequence information, program information and timing 
information. The sequence information describes the arrival time 

10 basis (ATC) and system time basis (STC) sequences. For example, 
the sequence information indicates, among other things, the number 
of sequences, the beginning and ending time information for each 
sequence, the address of the first source packet in each sequence 
and the PID of the transport packets in each sequence. A sequence 

15 of source packets in which the contents of a program is constant 
is called a program sequence. The program information indicates, 
among other things, the number of program sequences, the starting 
address for each program sequence, and the PID(s) of transport 
packets, in a program sequence. 

20 The timing information is referred to as characteristic point 

information (CPI) . One form of CPI is the entry point (EP) map. 
The EP map maps a presentation time stamp (e.g. , on an arrival time 
basis (ATC) and/or a system time basis (STC) ) to a source packet 
address (i.e. , source packet number) . The presentation time stamp 

25 (PTS) and the source packet number (SPN) are related to an entry 
point in the AV stream; namely, the PTS and its related SPN point 
to an entry point on the AV stream. The packet pointed to is often 
referred to as the entry point packet. 

The PLAYLIST directory includes one or more playlist files. 

30 The concept of a playlist has been introduced to promote, ease of 
editing/assembling clips for playback. A playlist file is a 
collection of playing intervals in the clips . Each playing interval 
is referred to as a playitem. The playlist file, among other things, 

4 
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identifies each playitem forming the playlist, and each playitem, 
among other things, is a pair of IN-point and OUT-point that point 
to positions on a time axis of the clip file (e.g., presentation 
- time stamps on an- AXe ror .STG -basis ) -T^ may also 

5 include sub-playitems that also provide a pair of IN-point and 
OUT-poiht that point to positions on a time axis of a clip file. 
Expressed another way, the playlist file identifies playitems and 
sub-playitems, each playitem or sub-playitem points to a clip file 
or portion thereof and identifies the clip information file 

10 associated with the clip file. The clip information file is used, 
among other things, to map the playitems to the clip file of source 
packets. Playlists may also include playlist marks which point to 
specific places (e.g., a specific address) in a clip file 

The general information files (not shown) provide general 

15 information for managing the reproduction of the A/V streams 
recorded on the optical disk. 

In addition to illustrating the data structure of the 
recording medium according to an embodiment of the present 
invention, Pig. 1 represents the areas of the recording medium. 

20 For example, the general information files are recorded in one or 
more general information areas, the playlist directory is recorded 
in one or more playlist directory areas, each playlist in a playlist 
directory is recorded in one or more playlist areas of the recording 
medium, etc. Fig. 2 illustrates an example of a recording medium 

25 having the data structure of Fig. 1 stored thereon. As shown, the 
recording medium includes a file system information area, a data 
base area and an A/V stream area. The data base area includes a 
general information file and playlist information area and a clip 
information area. The general information file and playlist 

30 information area have the general information files recorded in 
a general information file area thereof, and the PLAYLIST directory 
and playlist files recorded in a playlist information area thereof. 
The clip information area has the CLIPINFO directory and associated 

5 
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clip information files recorded therein. The A/V stream area has 
the A/V streams for the various titles recorded therein. 

Video and audio data are typically organized as individual 
titles;; for example-, different movies represented by the video -and 
5 audio data are organized as different titles. Furthermore, a title 
may be organized into individual chapters in much the same way a 
book is often organized into chapters. 

Because of the large storage capacity of the newer, 
high-density recording media such as BD-ROM and BD-RE optical disks, 

10 different titles, various versions of a title or portions of a title 
maybe recorded, and therefore, reproduced from the recording media. 
For example, video data representing different camera angles may 
be recorded on the recording medium. As another example, versions 
of title or portions thereof associated with different languages 

15 may be recorded on the recording medium. As a still further example, 
a director's version and a theatrical version of a title may be 
recorded on the recording medium. Or, an adult version, young adult 
version and young child version (i.e., different parental control 
versions) of a title or portions of a title may be recorded on the 

20 recording medium. Each version, camera angle, etc. represents a 
different reproduction path, and the video data in these instances 
is referred to as multiple reproduction path video data. 

Because of the large storage capacity of the newer, 
high-density recording media such as BD-ROM, still images or 

25 pictures may be recorded and reproduced in an organized and/or user 
interactive fashion, for example, as slideshows. The data 
structure for managing reproduction of still pictures for a 
high-density recording medium in accordance with embodiments of 
the present invention will be described along with methods and 

30 apparatuses according to embodiments of the present invention for 
recording and reproducing still images. 

As will be appreciated from the above and following 
disclosure, still images maybe displayed as a sequential slideshow, 

6 
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a random/ shuffle slideshow, or a browsable slideshow. A sequential 
slideshow involves the reproduction of still images having limited 
duration in the order set forth by the playlist. This reproduction 
- -o£ -the-. St illv^ images may. al^^ occur in synchronized^-reproduotion, 
5 with audio data. A browsable slide show involves reproduction of 
still images having infinite duration in an order set forth by, 
for example, the playlist. Reproduction proceeds to a previous or 
subsequent still image based on user input. A random/shuf f le 
slideshow is a form of sequential or browsable slideshow in which 

10 the order to reproduce the still images is randomized. 

Figs. 3 and 4 illustrate an embodiment of a data structure 
and method for managing still images of a high-density recording 
medium such as a BD-ROM. As shown in Fig. 3, the component data 
streams of the still picture stream and the related data streams 

15 (e.g., the graphic & subtitle streams) are packetized into PES 
packets on a still image basis. Namely, each PES packet of the still 
picture stream includes a single still picture, and the associated 
PES packets of the related data include the related data associated 
with the still picture (e.g., for reproduction in synchronization 

20 with the associated still picture) . The still picture together with 
related data to be reproduced in synchronization therewith are 
grouped into a still picture unit. On a still picture unit basis, 
the still picture stream and related data streams are multiplexed 
into a still picture file of MPEG2 transport streams. 

25 Pig. 3 further shows a clip information file corresponding 

to the still picture file. The clip information file includes an 
entry point map (EP_MAP) . Individual entry points (EP #1 - #k) in 
the EP map contain respective navigation information for accessing 
a head recording position of a corresponding still picture unit. 

30 The navigation information, for exarrple, includes source packet 
number entry point start (SPN_EP_Start) information indicating the 
start recording position of the corresponding still picture unit. 
Fig. 4 illustrates a playlist for play control of the still 
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picture file discussed above with respect to Fig. 3. As shown, a 
playitem (Playltem) in the playlist contains in-picture 
(IN_j)icture) information and out -picture (OUT_picture) 
V -information, corresponding respectiYely.J:or,±he-atart position and 
5 end position of the still images in the still picture file to 
reproduce. A sub-playitem (SubPlayltem) in the playlist contains 
sub-playitem in-time (SubPlayItem_IN_time) information and 
sub-playitem out- time (SubPlayItem_OUT_time) information for a 
separate audio file to be reproduced in association with the still 
10 picture file. The audio data may be reproduced in either a 

synchronized or unsychronized fashion with the associated still 
images . 

The playlist further includes a playlist mark, referred to 
hereinafter as still mark, pointing to each still picture. The 

15 presentation duration information for the still picture and 

related data included in a still picture unit may be recorded in 
the still mark corresponding to the still picture unit. 
Alternatively or additionally, the presentation duration 
information may be contained in the playitem. 

20 The still marks are particularly useful when skipping between 

pictures during a browsable slideshow. It will further be 
appreciated that the still picture file or portions thereof can 
be simultaneously associated with a number of playlist s with 
presentation durations different from each other. 

25 Presentation time stamps (PTSs) are recorded in each PES 

packet and/or each entry point. A PTS has a value in proportion 
to, for example, the well-known program clock reference (PGR) 
value; and therefore, as described below, will have a value 
proportional to a time base defined by PCRs referred to as STC (e.g. 

30 a system time based on of PCRs) . As is well-known, the PGR is a 
time stamp added to packets in an MPEG2 transport stream according 
to the MPEG2 standard. When a still picture has an infinite 
presentation duration,, the STC (e.g. , PGR count) maintains the same 

8 



Best Available Copy 

WO 2004/088661 



PCT/KR2004/000369 



value and a PTS proportional thereto is recorded in the PES packet 
of the corresponding still picture. Accordingly, an identical PTS 
is recorded to both the PES packet of a still picture with infinite 
—- presentation duration and-fehe -PES -packet-of the preceding still 
5 picture. For example, a reproducing apparatus may calculate the 
difference between the PTSs recorded in subsequent entry points 
or subsequent still picture PESs to determine presentation 
duration for the second of the two consecutive still pictures. When 
the difference between the PTSs is zero, the reproducing apparatus 

10 reproduces the corresponding still picture with infinite 
presentation duration - meaning that the still picture is 
reproduced iintil user input providing instructions to the contrary 
is received. Otherwise, the reproducing apparatus reproduces the 
still picture for the calculated duration. 

15 In other words, the reproducing apparatus, at the time of, 

for example, reproducing slideshows of still pictures, decides 
whether the presentation duration for each still picture is 
infinite or finite. When the presentation duration corresponds to 
infinite, the reproducing apparatus does not increase the STC but 

20 maintains the previous value. On the contrary, when the 
presentation duration is finite, the reproducing apparatus 
conducts a series of operations to normally increase the STC. 

Fig. 5 illustrates a schematic diagram of a partial structure 
of an optical disc reproducing apparatus according to an embodiment 

25 of the present invention. As shown, the optical disc reproducing 
apparatus includes an optical pickup 111 for reproducing data from 
the an optical disk. A VDP {Video Disc Play) system 112 controls 
the reproduction operation of the optical pickup 111 and 
demodulates the data reproduced by the optical pickup 111. The VDP 

30 112 produces an AV stream, which may also be fed to a D/A converter 
113 to generate an analog version of the AV stream. 

The VDP system 112 controls the optical pickup 111 and 
demodulates the reproduced data based on user input received from 

9 
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a user interface and the navigation and management information 
recorded on the optical disk in accordance with the present 
invention. For example, the VDP system 112 makes reference to still 
marks includejd.>in.:^--playlist-and an- entry .point map included in 7 
5 a clip information -file as described above to reproduce a still 
picture file. Namely, the VDP system 112 reads out a still picture, 
graphic data, and subtitle data of each still picture unit 
according to the order of entry points (EP #1, #2, ...) recorded in 
the entry point map. Then, the VDP system 112 conducts a series 

10 of operations for reproducing still pictures, which may be (i) 
reproduced for a fixed time duration according to the presentation 
duration information included in the still marks or determined form 
the PTSs, or (ii) reproduced in the form of skipped reproduction 
in units of the still picture unit, for example, corresponding to 

15 each of the still marks, according to the key input of the user. 

As shown in Fig. 6, the VDP system 112 may comprise a switch 
120, a track buffer 121, a TS demultiplexer 122, a video buffer 
123, a graphic buffer 124, a subtitle buffer 125, an audio buffer 
126, a video decoder 127, a graphic decoder 128, a subtitle decoder 

20 129, an audio decoder 130, a microcomputer 131, a first STC 
generator 140 and a second STC generator 141. 

The microcomputer 131 controls the operation of the switch 
120 according to the key input of a user or presentation duration 
information, thereby selectively feeding a still picture (V) , 

25 graphic data (G) , and subtitle data (ST) into the track buffer 121. 
The TS demultiplexer 122 makes reference to the packet ID (PID) 
of the data stream temporarily stored in the track buffer 121 and 
distributes still picture data, graphic data, and subtitle data 
into the video buffer 123, the graphic buffer 124, and the subtitle 

30 buffer 125, respectively. 

The video decoder 127 decodes the still picture data, the 
graphic decoder 128 decodes the graphic data, and the subtitle 

. . decoder 129 decodes the subtitle data. As a result, a single still 

10 
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picture and related graphic and subtitle data are reproduced, for 
example, in synchronization. 

Similarly, the microcomputer 131 controls the operation of 
- :.%he. switGh-~120 anjd-sele^^^ audio data (A) read^^ut-^f rpm- - 

5 an optical disc into the track buffer 121. The TS demultiplexer 
122 makes reference to the packet ID (PID) of the audio data stream 
temporarily stored in the track buffer 121, thereby separating the 
audio data into the audio buffer 126. 

The TS demultiplexer 122 separates each audio presentation 

10 time stamp (A_PTS) from the reproduced audio data stream and sends 
the A_PTSs to the audio decoder 130. The TS demultiplexer 122 also 
separates audio program clock references (A_PCRs) from the 
reproduced audio data stream and sends the A_PCRs to the first STC 
generator 140, which counts the A_PCR to generate an audio STC. 

15 Then, the audio STC {A_STC) is sent to the audio decoder 130. The 
audio decoder 130 compares the A_PTS with the A_STC and outputs 
decoded audio when they are of the same value. 

In a similar manner, the TS demultiplexer 122 separates each 
still picture presentation time stamp {S_PTS) from the reproduced 

20 still picture data stream and sends the S_PTSs to an MPEG decoder 
170 formed by the video decoder 127, the graphic decoder 128, and 
the subtitle decoder 129. The TS demultiplexer 122 also separates 
still picture data program clock references {S_PCRs) from the 
reproduced still picture data stream and sends the S_PCRs to the 

25 second STC generator 141, which counts the S_PCRs to generate an 
still picture STC. Then, the still STC {S_STC) is sent to the MPEG 
decoder 170. 

The MPEG decoder 170 keeps comparing the S_PTS with the S_STC 
and outputs a still image when they are of the same value. If the 
30 presentation duration of the still image is limitless, the 

microcomputer 131 controls the second STC generator 141 to stop 
its counting operation. 

If another still picture is to be displayed according to user 

11 
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key input, the microcomputer 131 loads the PGR obtained from the 
still picture to be displayed into the second STC generator 141 
and resumes the PGR counting operation. 

-r:=As-a* result, "-the optical disk- reproducing^, apparatus- may 
5 reproduce still images recorded on the optical disk using the MPEG 
decoder 170 for reproducing movie data by utilizing the first and 
second STC generators 140 and 141 and perform browsable slideshow 
operations for the still images responsive to user key input. With 
respect to the browsable slideshows, for example, the audio data 

10 and still picture data (or still and related picture data) may be 
reproduced independently because of the separate and independent 
STG control provided by the first and second STC generators 140 
and 141. Namely, if a user changes the still picture being displayed 
as described above, this does not affect the decoding of the audio 

15 data. 

In the VDP system 112, a STC adder 151 may be employed instead 
of the second STC generator 141 such as shown in FIG. 7. When 
presenting a still picture having a limitless presentation 
duration, the microcomputer 131 controls the STG adder 151 in such 
20 a way that the S_STG generated thereby is not applied to the MPEG 
decoder 170. 

If a different still picture is to be displayed, the 
microcomputer 131 calculates the difference between a PGR obtained 
from the still picture to be displayed and the A_STC reproduced 
25 by the first STC generator 140, and outputs the difference to the 
STC adder 151 as a PGR offset. 

The STC adder 151 adds the A_STC from the STC generator 140 
and the PGR offset from the microcomputer 131, and outputs the sum 
as the S_STG to the MPEG decoder 170. As a result, the optical disk 
30 reproducing apparatus may reproduce still images recorded on the 
optical disk using the MPEG decoder 170 for reproducing movie data 
by utilizing the S_STG and output from the STG adder 151 and may 
perform browsable slideshow operations for the still images 

12 
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responsive to user key input. 

Fig, 8 illustrates a schematic diagram of an embodiment of 
an optical disk recording and reproducing apparatus according to 
the present invention. -As sho,wn7 -'an-^W—encoder 9 receives '' and- 
5 encodes data (e.g., still image data, audio data, etc.). The AV 
encoder 9 outputs the encoded data along with coding information 
and stream attribute information. A multiplexer 8 multiplexes the 
encoded data based on the coding information and stream attribute 
information to create, for example, an MPEG-2 transport stream. 

10 A source packetizer 7 packetizes the transport packets from the 
multiplexer 8 into source packets in accordance with the 
audio/video format of the optical disk. As shown in Fig. 8, the- 
operations of the AV encoder 9, the multiplexer 8 and the source 
packetizer 7 are controlled by a controller 10. The controller 10 

15 receives user input on the recording operation, and provides 
control info3rmation to AV encoder 9, multiplexer 8 and the source 
packetizer 7, For example, the controller 10 instructs the AV 
encoder 9 on the type of encoding to perform, instructs the 
multiplexer 8 on the transport stream to create, and instructs the 

20 source packetizer 7 on the source packet format. The controller 
10 further controls a drive 3 to record the output from the source 
packetizer 7 on the optical disk. 

The controller 10 also creates the navigation and management 
information for managing reproduction of the data being recorded 

25 on the optical disk. For example, based on information received 
via the user interface (e.g., instruction set saved on disk, 
provided over an intranet or internet by a computer system, etc.) 
the controller 10 controls the drive 3 to record one or more of 
the data structures of Figs. 1-4 on the optical disk. 

30 During reproduction, the controller 10 controls the drive 3 

to reproduce this data structure. Based on the information 
contained therein, as well as user input received over the user 
interface (e.g., control buttons on the recording and reproducing 

13 
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apparatus or a remote associated with the apparatus) , the 
controller 10 controls the drive 3 to reproduce the data from the 
optical disk. For example, as discussed above with respect to the 
embodiments of th^^presentTd^venbi^^^ ar:St ill-image or still images 
5 may be reproduced in association with audio data based on the 
navigation information. Furthermore, an image or group of images 
may be reproduced as a slideshow or portion of a slideshow. As also 
discussed, a slideshow may be synchronized, browsable, etc. 
The reproduced source packets are received by a source 

10 depacketizer 4 and converted into a data stream (e.g., an MPEG-2 
transport packet stream) . A demultiplexer 5 demultiplexes the data 
stream into encoded data . An AV decoder 6 decodes the encoded data 
to produce the original data that was feed to the AV encoder 9. 
During reproduction, the controller 10 controls the operation of 

15 the source depacketizer 4, demultiplexer 5 and AV decoder 6. The 
controller 10 receives user input on the reproducing operation, 
and provides control information to AV decoder 6, demultiplexer 
5 and the source packetizer 4. For example, the controller 10 
instructs the AV decoder 9 on the type of decoding to perform, 

20 instructs the demultiplexer 5 on the transport stream to 

demultiplex, and instructs the source depacketizer 4 on the source 
packet format. 

While Fig. 8 has been described as a recording and reproducing 
apparatus, it will be understood that only a recording or only a 
25 reproducing apparatus may be provided using those portions of Fig. 
8 providing the recording or reproducing function. 

As will be appreciated from the forgoing disclosure, the 
present invention provides a recording medium having a data 
structure for managing still images and audio data recorded on a 
30 high-density recording medium (e.g. , a high-density optical disk 
such as a BD-ROM) . For example, the data structure allows for 
displaying still images and audio data in various ways. 

The method of managing still images for a high-density 

14 



Best Available Copy 

WO 2004/088661 



PCT/KR2004/000369 



recording medium in accordance with the invention provides various 
still control operations and allows effective linked reproduction 
of still images along with associated subtitle data or graphic 

images *--_^-wz.^rT--r - — _ - 

5 As apparent from the above description, the present invention 

provides methods and apparatuses for recording a data structure 
on a high density recording medium for managing still images and 
audio data recorded on the recording medium. 

The above description further provides methods and 

10 apparatuses for reproducing still image and audio data recorded 
on a high density recording medium. 

While the invention has been disclosed with respect to a 
limited number of embodiments, those skilled in the art, having 
the benefit of this disclosure, will appreciate numerous 

15 modifications and variations there from. For example, while 

described with respect to a Blu-ray ROM optical disk in several 
instances, the present invention is not limited to this standard 
of optical disk or to optical disks. It is intended that all such 
modifications and variations fall within the spirit and scope of 

20 the invention. 



15 



Best Available Copy 

WO 2004/088661 



PCT/KR2004/000369 



CLAIMS 

« 

- r:.-.-. 2, A'method of reproducing still • picture data^ and audio data • ' - 
from a recording medium, comprising: 

decoding still picture data and the audio data reproduced 
5 from the recording medium based on respect ive, independent system 
times (STCs) . 

2. The method of claim 1, further comprising: 
generating a first STC for the still picture data based on 

the still picture data reproduced from the recording medium; and 
10 generating a second STC for the audio data based on the audio 

data reproduced from the recording medium. 

3 . The method of claim 2 , wherein 

the generating the first STC step generates the first STC from 
program clock references (PCRs) in the still picture data; and 
15 the generating the second STC step generates the second STC 

from PCRs in the audio data. 

4. The method of claim 3, wherein the decoding step decodes 
the still picture data and the audio data based on the first and 
second STCs, respectively, and presentation time stamps (PTSs) in 

20 the respective still picture and audio data. 

5. The method of claim 1, wherein the decoding step decodes 
the still picture data and the audio data based on the respective, 
independent STCs, and presentation time stamps (PTSs) in the 
respective still picture and audio data, 

25 6. The method of claim 1, further comprising: 

reproducing transport streams of the still picture and audio 

data; 

demultiplexing the transport streams into the still picture 
data and the audio data to obtain first program clock references 
30 (PCRs) from the still picture data and second PCRs from the audio 
data; 
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generating first and second STCs from the first and second 
PCRs, respectively; and wherein 
the decoding step includes, 

, -J- , decoding the demultiplexed:- st:iia.;.,picture data based on- the — 

5 first STCs, and 

decoding the demultiplexed audio data based on the second 

STCs. 

7. The method of claim 1, wherein 

the demultiplexing step further obtains first presentation 
10 time stamps (PTSs) for the still picture data and second PTSs for 
the audio data; and 

the decoding the demultiplexed still picture data decodes the 
still picture data based on the first STCs and the first PTSs; and 
the decoding the demultiplexed audio data decodes the audio 
15 data based on the second STCs and the second PTSs. 

8. The method of claim 1, further comprising: 
reproducing at least one playlist from the recording medium, 

the playlist including at least one playitem and at least one 

sub-playitem, the playitem providing navigation information for 
20 reproducing at least the still picture data from a first file, the 

sub-playitem providing navigation information for reproducing the 

audio data from a second file; 

reproducing the still picture data from the first file based 

on the navigation information in the playitem; and 
25 reproducing the audio data from the second file based on the 

navigation information in the sub-playitem. 

9. The method of claim 8, wherein 

the playitem provides navigation information for reproducing 
presentation data from the first file, the presentation data 
30 includes at least the still picture data and related data 
associated with the still picture data; and 

the reproducing the still picture data step reproduces the 
presentation data. . 
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10. The method of claim 9, wherein the presentation data does 
•not include audio data. 

11- The method of claim 9, wherein the related data includes 
--- -- at least one of- graphics.Hd^tavand siibtitle--dataV " -* " 

5 12. The method of claim 9, wherein the presentation data is 

divided into one or more still picture units such that each still 
picture unit includes at least one still picture and associated 
related data. 

13. The method of claim 12, wherein the presentation data is 
10 multiplexed into a transport stream on a still picture \init by still 

picture xinit basis. 

14. The method of claim 13, wherein each elementary stream 
of the presentation data are aligned within the still picture unit. 

15. The method of claim 14, wherein each elementary stream 
15 is a packetized elementary stream. 

16. The method of claim 15, wherein each still picture unit 
includes one packet from each packetized elementary stream. 

17. The recording medium of claim 13, further comprising; 
reproducing a clip information file from the recording medium, 

20 the clip information file including at least one entry point map, 
the entry point map including at least one entry point providing 
at least an address of a still picture in the still picture data; 
and wherein 

the reproducing the still picture data step reproduces the 
25 still picture data from the first file based on the navigation 
information in the playitem and entry point map. 

18 . The recording medium of claim 17, wherein the entry point 
map includes an entry point associated with each still picture 
unit . 

30 19. The method of claim 9, wherein the playlist further 

includes at least one playlist mark pointing to a still picture 
in the still picture data. 

20. The method of claim 9, wherein the playlist mark provides 
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information on a duration to reproduce the still picture pointed 
to by the playlist mark. 

21. method of claim 1, further comprising: 

- reprp4ueing.-at,leas.t^ from the recording medlum>r- 

5 the playlist file including at least one playitem and at Ifeast one 
sub-playitem, the playitem providing navigation information for 
reproducing at least still picture stream from a first data stream, 
the sub-playitem providing navigation information for reproducing 
an audio stream from a second data stream separate from the first 
10 data stream; 

reproducing a portion of the first data stream as the still 
picture data based on the navigation information in the playitem; 
and 

reproducing a portion of the second data stream as the audio 
15 data based on the navigation information in the sub-playitem. 

22. The method of claim 21, wherein the first data stream is 
a transport stream. 

23. The method of claim 22, wherein the transport stream 
includes packetized elementary streams of the still picture data 

20 and related data. 

24 . A method of reproducing still picture data and audio data 
from a recording medium, cortqprising: 

generating a first STC for the still picture data based on 
the still picture data reproduced from the recording medium; 
25 generating a second STC for the audio data based on the audio 

data reproduced from the recording medium; 

decoding the still picture data reproduced from the recording 
medium based on the first STC; and 

decoding the audio data reproduced from the recording medium 
30 based on the second STC. 

25 . An apparatus for reproducing still picture data and audio 
data from a recording medium, comprising: 

a decoder decoding the still picture data based on a first 
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system time (STCs) ; and 

a decoder decoding the audio data based on a second STC, 
independent of the first STC. 
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